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ABSTRACT : 

PURPOSE : To reduce encoding error and to improve the 
reproduction by- 
providing a means which extracts the specific part in a screen and 
a processing 

means performing the processing to reduce the encoding error than 
that of other 
parts . 

CONSTITUTION: Picture data are divided into plural blocks by a 
block 

dividing circuit 101 and are inputted to a polygon calculation 
circuit 105 and 

to an edge detection circuit 102. The circuit 102 calculates the 
edge position 

in each block and the inclination of the edge . A weighting table 
decision 

circuit 103 accepts the result and decides the weight coefficient 
for each 

picture element for weighting . A base function calculation circuit 
104 
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calculates a base function matrix C by the specific formula when 
the circuit 

103 decides the matrix W of the weight coefficient. The circuit 
105 uses the 

matrix of the picture element value from the matrix W and the 
matrix C, and the 

matrix of the picture element value from the circuit 11 to 
calculate the matrix 

of the polygon vertex value. The polygon vartex value is quantized 
by a 

quantization circuit 106 and is sent at the side of decoding. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] this invention expresses the pixel value change in a screen on a curved surface, decreases the coding 
error of a particular part in the coding system of the picture which encodes and transmits information required in order to 
generate the curved surface, and relates to the picture coding equipment which can raise the quality of image of the decode 
picture of the portion. 
[0002] 

[Description of the Prior Art] In a multimedia system, although image data is one of the most important media in respect of the 
visual effect given to a user, introduction of the compression technology for encoding the immense amount of information 
efficiently is also indispensable. Therefore, conventionally, various methods, such as DCT (discrete cosine transform) and VQ 
(vector quantization), have been examined. 

[0003] although image processings technique, such as expansion/reduction, rotation, and deformation, may be needed here in 
case a picture is actually displayed — these various image processings ~ each pixel of a subject-copy image ~ receiving ~ 
coming out ~ if there is nothing and it can apply to a number fewer than the number of pixels of compressed data, accumulation 
of a processing picture, transmission, and a display will become efficient much more 

[0004] However, in conventional DCT and conventional VQ, since the information accumulated or transmitted was the 
coefficient of a DCT conversion side, the number of a reproduction vector, etc., the application of an image processing to 
compressed data was difficult. 

[0005] On the other hand, it is known that, as for B -spline surface or a BETSUIE curved surface, the relation between each 
polygon peak and the curved surface generated from there will not be influenced by image processings, such as affine 
transformation. Therefore, the value of the point on a curved surface is made to correspond to image data, and if a compression 
method which makes applicable to coding the polygon peak which generates this curved surface is establishable, it will become 
possible to obtain the result same with having processed to the original data only by giving an image processing to the 
compressed polygon peak value. 

[0006] Next, the technique in the case of applying the above-mentioned curved surface which has such an advantage to 
compression coding is mentioned as an example, and B-spline surface is explained. The value of the point on B -spline surface is 
determined by the weighted mean to the specified polygon peak value, and, generally is expressed by the following formula (for 
example, refer to Fujio Yamaguchi translation "CG" (Nikkan Kogyo Shimbun Ltd.)). 
[0007] 
[Equation 1] 

n+f o+l 

DG,w)~ £ £ B st N gp (u) M tq (w) (1) 
s=l t=l 

[0008] Here, D is the parameter defined in the value of the point on a curved surface, and the direction of an axis of coordinates 
in which (u, w) intersect perpendicularly mutually. Moreover, Bst shows the polygon peak and n+1 and m+1 are the numbers of 
the polygon peaks of the direction of u, and the direction of w, respectively. Furthermore, Nsp (u) The basis function (function 
for taking a weighted mean) of the order p in the direction of u, and Mtq (w) It is the basis function of the order q in the direction 
of w. 

[0009] The perpendicular and horizontal direction of a subject-copy image are set up in u of a formula (1), and the direction of 
w, respectively, and it is the value D (u, w). It is made to correspond to a pixel value. And the polygon peak value Bst for 
generating this curved surface is made applicable [ final ] to coding. The example in the case of expressing pixel value change of 
a 8 pixel x 8-pixel block by 4x4 polygons is shown in drawing 7 . 

[0010] the parameter of D corresponding to each now and pixel value ~ ** (k(uk and wh) = 1,2, --, LI, h= 1, 2, --, L2 : L LI, 
the number of pixels respectively perpendicular [ 2 ] and horizontal) ~ if it carries out, the notation as shown below can be 
simplified 
[0011] 

-> (uk and wh) zi (i= 1, 2, --, L:L=L1 x L2) 
Bst->Bj (p 1, 2, --, H:H= (n+1) (m+1)) 
Nsp(uk) Mtq(wh) ->Kj (zi) 
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It is [0012] when a formula (1) is rewritten according to this simplification. 
[Equation 2] 



D(z t ) = E B j K j (z i > 



(2) 



It becomes. 

[0013] Furthermore, a matrix as shown below is defined. 
B= [Bl B-2 B3 - BH] t (3-a) 
D= [D(Z1) D(Z2) D (ZL)] t (3-b) 
[0014] 
[Equation 3] 



c = 



K l O. > 



K 2 (Z x ) 
K 2 (Z 2 ) 



K, (Z, ) 
K H (Z 2 ) 



K 1 (Z L> K 2 (Z L> ™ K H (Z L> 



C3-c) 



It is a formula when formula (3-a) - (3-c) is used (2). D=CB (4) 

It can write. Therefore, if it is L=H (the number of data and the number of the polygon peaks of the HARASHIN number are 
equal), a polygon peak value will be calculated as follows using the inverse matrix C-l of the basis-function matrix C 
[0015] 
B=C-1D(5) 

Although data can be completely restored using a formula (5), if it stands on the viewpoint of compressing by coding of a 
polygon peak value, it is necessary to become L>H. At this time, C cannot become a square matrix and cannot calculate B with 
this. Therefore, the approximate solution of B is calculated on the conditions of the square error minimum with the HARASHIN 
number, and the technique of obtaining restoration data is introduced. Pixel value fi of a now subject-copy image A total of E of 
a square error with the HARASHIN number which the point D (zi) on the curved surface in a formula (2) has when it carries out 
(D) [0016] 
[Equation 4] 



ECD) - 2 <■>(*! > - f i ) 
1=1 



(6) 



It becomes. As for the conditions of the square error rniriimum, the partial differential to a formula (6) means a bird clapper in 
zero in all j. Therefore, [0017] 
[Equation 5] 

J* 3D(z. ) 
X 2 CD(z. ) - f 1 ) x — 



dB 



dB 



j 1=1 
L 

= 2 £ < D < z i ) " f j ) K. (z. ) = 0 
i=l 



(7) 



Therefore, it is [0018] when a formula (2) is substituted and arranged. 
[Equation 6] 



B ! £ K t k t ) Kj Cz t ) +B 2 X K 2 (z. ) K j (z. ) + 



i=l 



L 

z 

i-1 



L L 

+b h £ K n iz i ) K j - S f i K , 

i=l W 



(8) 

[0019] A formula (8) is the matrices B and C defined previously and the transposed matrix Ct of those. It uses. Ct CB=Ct F (9) 
It corrects. F= [fl f2 ~ fL] It can be written as t. Since Ct C serves as a square matrix, the polygon peak value for the 
approximation curved-surface generation which fulfills the conditions of the square error minimum with the HARASHIN number 
can be calculated by the following formulas. 
[0020] 

B=(Ct C)-lCtF(lO) 

This B is set as the object of coding and reproduction data F of F is called for by the following formulas by the decode side 
using the reproduction data B'. 
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[0021] 
F'=CB'(11) 

Here, the important section composition of the picture coding network which performs the above-mentioned coding process is 
shown in drawing 8 . First, the polygon peak value which an input screen is divided into a block by the block dividing network 
801 (it is a 8 pixel x 8-pixel block in the case of the example of drawing 7 ), and should be encoded in a polygon calculation 
circuit is calculated (when it is the example of drawing 7 , it is the polygon peak value of a total of 16 pieces of 4x4). At this 
time, the matrix of a formula (3-c) is prepared for the basis-function calculation circuit 803, calculation of a formula (10) is 
performed using the data (F of a formula (9)) from the block dividing network 801, and the basis function in the basis-function 
calculation circuit 803, and the polygon peak value B is calculated in the polygon calculation circuit 802. It is quantized in the 
quantization circuit 804 and each polygon peak value is transmitted to a decode side. 

[0022] Thus, the conventional technique was calculating the polygon peak value the condition [ the mere square error minimum 
of pixel value change and curved-surface change ] about each field (each block at the time of carrying out block division of the 
picture beforehand) which is going to express pixel value change on a curved surface. 

[0023] When performing compression coding generally, in order to attain high compressibility by omitting a high frequency 
component, it becomes impossible to express a steep edge and dotage is produced. Moreover, in order to perform compression 
processing per block, the continuity of the pixel value change during a block is not taken into consideration, but block distortion 
which originates in the discontinuity of pixel value change in the block boundary section as a result occurs. It is desirable to 
perform a certain adaptation-processing to the portion, and to raise the repeatability of a picture to dotage or block distortion. 
However, about the technique mentioned above, it was only having only satisfied the square error minimum of pixel value 
change and curved-surface change, and since neither such an edge nor the continuity of the pixel value change during a block 
was taken into consideration, a result which causes quality-of-image degradation of the portion had been brought. 
[0024] 

[Problem(s) to be Solved by the Invention] As explained above, since only the square error minimum of pixel value change and 
curved-surface change was made into a constraint, compression processing was performed and neither the repeatability of an 
edge nor the continuity of the pixel value change during a block was taken into consideration, by the conventional technique of 
expressing the pixel value change in a screen on a curved surface, there was a problem of causing quality-of-image degradation 
of dotage, block distortion, etc. in the portion. 

[0025] this invention is made in order to solve the above-mentioned technical problem, it performs compression processing in 
consideration of the repeatability of an edge portion, or the continuity of the pixel value change during a block, and aims at 
offering the picture coding equipment which raises the repeatability of these portions. 
[0026] 

[Means for Solving the Problem] In this invention, it is characterized by having an extraction means to extract the particular part 
in this screen, and a processing means to process to this particular part for making the coding error smaller than other portions in 
the picture coding equipment which encodes information required in order to express the pixel value change in a screen on a 
curved surface and to generate the curved surface. 

[0027] When the aforementioned particular part considers at least as one side of the edge section which exists in the block 
boundary section at the time of dividing a picture into a block, or a block, it is desirable. It is desirable, if B-spline surface or a 
BETSUIE curved surface is used as the aforementioned curved surface and it is made to include a polygon peak value in the 
aforementioned information at least. 

[0028] Moreover, as for the aforementioned processing means, it is good to be made to perform processing which makes the 
multiplex peak the polygon peak which weighting processing is performed [ peak ] to evaluation of the coding error of the 
particular part concerned, or generates this particular part. What is necessary is just to include other additional information, such 
as a position of the multiplex peak, and a multiplicity, in the aforementioned information further in the case of the latter. 
[0029] 

[Function] With the picture coding equipment of this invention, the edge portion which exists in the block boundary portion at 
the time of dividing into a block the particular part in the screen which should be encoded, for example, a picture, or a block is 
extracted, and this screen is encoded, after processing for making the coding error of this portion smaller than other portions. 
[0030] Consequently, the coding performance of a desired portion can be raised. Since the coding error of this portion can be 
especially made smaller than other portions in consideration of the repeatability of an edge portion, or the continuity of the pixel 
value change during a block, it becomes possible to cut down quality-of-image degradation of these portions that had become a 
problem conventionally. 
[0031] 

[Example] Hereafter, the example of this invention is explained with reference to a drawing. Drawing 1 is the block diagram 
showing the important section composition of the picture coding equipment concerning the 1st example of this invention. This 
picture coding equipment is equipped with the block dividing network 101, the edge-detection circuit 102, the weight table 103, 
the basis-function calculation circuit 104, the polygon calculation circuit 105, and the quantization circuit 106. 
[0032] this example applies this invention to compression coding using B-spline surface mentioned above, and adds 
improvement to the conventional formula (6) which calculates the square error of pixel value change and curved-surface change, 
and the feature is that it has introduced the technique of performing weighting processing which the error of a portion to raise 
repeatability reflects in an error evaluation value more greatly. 

[0033] Hereafter, the theory about the above-mentioned technique is explained. In addition, in this example, since formula (1) - 



3 of 5 



10/18/03 3:32 PM 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



(5) mentioned above is used as it is, detailed explanation is omitted. First, in this example, the following evaluation formulas are 

introduced instead of the error evaluation formula of the formula (6) mentioned above. 

[0034] 

[Equation 7] , 

E(D) ■= __ W i ( D ^t > ~ f i > 2 (12) 

[0035] Here, it is Wi. It is the weighting factor of the square error in a position i, and Wi >0 is filled. That is, Wi If it is 1 
altogether, a formula (12) will be in agreement with a formula (6). Therefore, this Wi It is equivalent to performing weighting 
processing which the error of the portion reflects in an evaluation value more greatly than others to set up more greatly than 1 . It 
is Bj about all j like the case of a formula (6) about a formula (12). Partial-differential formula = it is [0036], when it sets up with 
0 and arranges. 
[Equation 8] 

B i Z W i K ! < z i > K j < z i > + B 2 £ W i K 2 (z i > K j (z i > + 

i«l i=l 

L I 
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(1 3) 



A formula (13) is the matrices B and C defined previously and the transposed matrix Ct of those. It uses and is [0037]. 
[Equation 9] 

(14) 
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It can write. Since Ct C serves as a square matrix, the polygon peak value for the approximation curved-surface generation which 
fulfills the conditions of the square error minimum with the HARASHIN number in the state where weighting was performed to 
the particular part can be calculated by the following formulas. 
[0038] 

B=(Ct WC)-lCt WF(15) 

This B is set as the object of coding. The curved surface generated from the polygon peak called for here is Wi. Since it means 
that the error of the portion by which weighting was carried out was set up so that it might become less than other portions by 
which weighting is not carried out, it will improve [ before the repeatability of this portion carries out weighting processing ]. 
[0039] Next, operation of each component of the picture coding equipment shown in drawing 1 is explained. It is inputted into 
the edge-detection circuit 102 while it is inputted into the polygon calculation circuit 105, after the image data of the input screen 
which should be encoded is divided into two or more blocks by the block dividing network 101 . 
[0040] In this edge-detection circuit 102, the edge position within each block and the degree of steepness of an edge are 
calculated, for example, the pixel value which adjoins each other mutually ~ the portion more than the threshold limit value to 
which difference is set beforehand is judged to be an edge 

[0041] Weighting factor Wi to each pixel for carrying out weighting in response to the result of the edge-detection circuit 102 in 1 
the weight table determination circuit 103 It determines. For example, as shown in drawing 2 , supposing the edge within a block 
is detected like 203 in drawing, only a part for the periphery will be made into a larger numeric value (here 10) than 1, and the 
other portion will be set to 1 . Or like drawing 3 , you may make a weighting factor small as it becomes far from an edge portion, 
or the contiguity pixel value calculated in the edge-detection circuit 102 again — the technique of setting up the weighting factor 
proportional to difference for every pixel is sufficient In addition, although the bigger value than 1 was set as the portion to carry 
out weighting here, as long as Wi >0 is filled, you may set up what value. Therefore, it is also possible to consider a portion to 
carry out weighting as as [ of 1 ], and to set the other portion as the value of 0<Wi <1 . Moreover, for the same reason, you may 
set up a weighting factor with decimal point. 

[0042] Although the above is the setting technique of the weighting factor which observed the repeatability of an edge portion, 
block distortion curtailment can also be observed. In this case, what is necessary is just to make weighting a boundary portion 
with a contiguity block like drawing 4 , since the repeatability of a block boundary portion will be raised. In addition, all the 
various methods explained by drawing 2 and drawing 3 can apply the technique and the value of weighting also here. Moreover, 
it is also possible by making weighting simultaneously an edge portion and a block boundary portion to raise the repeatability of 
an edge and the repeatability of a block boundary portion simultaneously. 
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[0043] Thus, the weight table determination circuit's 103 determination of the matrix W of a weighting factor calculates the 
basis-function matrix C expressed with the formula (3-c) mentioned above in the basis-function calculation circuit 104. 
[0044] And the matrix B of a polygon peak value is calculated by the formula (15) in the polygon calculation circuit 105 using 
the matrix F of the pixel value of the blocked subject-copy image which was given from Matrix W 5 the basis-function matrix C, 
and the block dividing network 101 of a weighting factor. 

[0045] The polygon peak value for this approximation curved-surface generation is transmitted to a decode side by the means 
which is not illustrated, after being quantized in the quantization circuit 106. Since weighting processing which the error of a 
portion to raise repeatability reflects in an error evaluation value more greatly is performed according to this example as 
explained above, the coding error of the portion concerned decreases, the repeatability of a reproduction picture improves, and it 
becomes possible to cut down quality-of-image degradation of dotage of the edge portion which had become a problem 
conventionally, block distortion, etc. 

[0046] Next, the picture coding equipment concerning the 2nd example of this invention is explained. The important section 
composition of the picture coding equipment of this example is shown in drawing 5 . This picture coding equipment is equipped 
with the block dividing network 101, the edge-detection circuit 102, a multiplicity and the multiplex peak spotting circuit 
(henceforth a multiplex peak determination circuit) 120, the basis-function calculation circuit 104, the polygon calculation circuit 
105, and the quantization circuit 106. 

[0047] Although rough composition is the same as that of the 1st example mentioned above almost at this example Instead of the 
weight table determination circuit 103 which determines the matrix W of the weighting factor of the 1st example In case the 
multiplex peak deterrnination circuit 120 is formed and a curved surface is generated, the feature is that it enabled expression of 
a steep edge by making into the multiplex peak the polygon peak used in order to generate the curved surface near an edge 
portion, and enlarging the curvature of the curved surface of the portion. 

[0048] Hereafter, the principle of the above-mentioned technique is explained using drawing 6 . Now, the case of B-spline curve 
is considered and suppose that there were the four polygon peaks (Bl, B-2, B3, B4) shown by 601,602,603,604 like drawing 6 . 
Supposing all of these four peaks are not the multiplex peak, a curve 605 will be generated using each peak value. 
[0049] Here, though it is the polygon peak of four points seemingly in this drawing supposing the peak 602 is the double peak, 
the five polygon peaks (Bl, B-2, B-2, B3, B4) will exist in fact. That is, it means the two peaks' being at the top 602 in this case, 
and the position and value being the same. Since the value on a curve (the same is said of the curved surface) is generated by the 
weighted mean of each polygon peak value, the value of B-2 will be calculated twice that two B-2s exist, and the value of the 
point on the curve of the neighborhood will approach the value of B-2 itself compared with the case where the value of B-2 
accepts it once and is involving. This degree that approaches becomes so remarkable that the multiplicity of the peak is large. It 
turns out that the generation curve in this case is set to 606, and the curvature of the peak 602 neighborhood is large compared 
with 605. A steep edge can be expressed using this property. 

[0050] Next, operation of each component of the picture coding equipment shown in drawing 5 is explained. The block divided 
by the block dividing network 101 is sent to the edge-detection circuit 102. 

[0051] Then, the position and the degree of steepness of an edge are inputted into the next multiplex peak determination circuit 
120, and determine the multiplicity according to the position and the degree of steepness of the polygon peak which then, should 
be made at the multiplex peak. It can respond now to such an edge steeper [ that what is necessary is just to make multiplex the 
polygon peak in the position specifically near the detected edge ] that a multiplicity is increased. In addition, the position and 
multiplicity of the multiplex peak are transmitted to a decode side as additional information. 

[0052] After that, like the 1st example, a basis function is calculated in the basis-function calculation circuit 104, and each 
polygon peak value is calculated by the formula (15) in the polygon calculation circuit 105 based on it. 

[0053] It is quantized in the quantization circuit 106 and these peak values are transmitted to a decode side by the means which 
is not illustrated. Since expression of a steep edge was enabled by making into the multiplex peak the polygon peak used in order 
to generate the curved surface near an edge portion, and enlarging the curvature of the curved surface of the portion according to 
this example when generating a curved surface as explained above, it becomes possible to cut down quality-of-image degradation 
of dotage of the edge portion which had become a problem conventionally etc. 

[0054] In addition, this invention is not limited to the above-mentioned example, it is the range which does not deviate from the 
summary of this invention, and can deform variously and can be carried out. Especially the means that makes the coding error of 
a particular part smaller than other portions can consider various modifications. Moreover, it is possible for it not to be similarly 
limited to B-spline surface about a curved surface, and to apply to other curved surfaces, such as a BETSUIE curved surface. 
[0055] 

[Effect of the Invention] It becomes possible to cut down quality-of-image degradation of dotage of the edge portion which the 
coding error of the portion concerned decreased into them, and the repeatability of a reproduction picture improved into them, 
and had turned into them with the problem conventionally since it encoded into them after processing into a desired portion, 
especially a desired edge portion, or a block boundary portion for making the coding error of this portion smaller than other 
portions, block distortion, etc. according to this invention. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The block diagram showing the important section composition of the picture coding equipment concerning the 1 st 
example of this invention 

[Drawing 21 Drawing showing an example of weighting 

[Drawing 3] Drawing showing other examples of weighting 

[Drawing 41 Drawing showing the example of further others of weighting 

[Drawing 5] The block diagram showing the important section composition of the picture coding equipment concerning the 2nd 
example of this invention 

[Drawing 6] Drawing explaining the multiplex peak and its effect 

[Drawing 71 Drawing showing the relation between the value of the point on a curved surface, and the polygon peak 
[Drawing 81 Drawing showing an example of conventional picture coding equipment 
[Description of Notations] 

101 — Block dividing network 

102 ~ Edge-detection circuit 

103 — Weight table detennination circuit 

1 04 — Basis-function calculation circuit 

105 -- Polygon calculation circuit 

106 -- Quantization circuit 

120 — A multiplicity and multiplex peak spotting circuit 

201.301.401 --Block 

202.302.402 ~ Weighting factor corresponding to the pixel 

203.303.403 - Edge 
601,602,603,604 -- Polygon peak 
605,606 — B-spline curve 

701 -- Polygon peak 

702 ~ Point on the curved surface corresponding to the pixel 
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